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(54) IMAGE PICKUP DEVICE 
(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image pickup device that can 
suppress generation of an unnatural image due to excessive edge emphasis in 
an ultra resolution photographing mode and express details of an object 
SOLUTION: The image pickup device is provided with a setting value revision 
means 58 that revises a coring setting value and a contour emphasis gain 
setting value depending on a mode selected from a usual photographing mode 
and an ultra resolution photographing mode. Thus, selecting a coring setting 
value and a gain setting value in the ultra resolution photographing mode smaller 
than those in the usual photographing mode can avoid an edge from being 
excessively emphasized and generate a natural image, a detailed image signal 
is utilized and a delicate mass sense of the object can excellently be expressed. 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2 **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 

CLAIMS 

[Claim(s)] 

[Claim 1]An imaging means characterized by comprising the following, a mode 
selection means which can set up super resolution photographing mode other 
than normal photographing mode, and super resolution photographing mode. 
A high-resolution-images creating means which generates high resolution 
images of one sheet from a picture of two or more sheets photoed by said 
imaging means. 

As opposed to a picture photoed by said imaging means in said normal mode, or 
said high resolution images in super resolution photographing mode. Coring and 



an edge enhancement process means to perform coring processing according to 
a coring preset value, and to perform an edge enhancement process to a picture 
signal by which coring processing was carried out further according to an edge 
enhancement gain set value, and a preset value alteration means which makes 
said each preset value change according to said photographing mode. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the lnvention]This invention relates to imaging devices, such as a digital 
camera which has super resolution photographing mode other than normal 
photographing mode. 
[0002] 

[Description of the Prior Art]ln order to generate the hyperresolution picture of 
one sheet from the taken image of two or more sheets, the digital camera which 
has the super resolution photographing mode which photos the picture of two or 
more sheets suitable for it is known. 

[0003]On the other hand, in order for a taken image to be in the tendency for 



edge to fade compared witli a actual photographic subject and to amend this 
under the influence of the resolution of a taking lens, an optical low pass filter, 
etc. in a digital camera, it is common to perform an edge enhancement process. 
[0004]Dotage of the above-mentioned edge is improved by specifically taking 
out only the high frequency component of the picture signals acquired by the 
image pick-up, applying a gain, and compounding it with a low-frequency 
component. 

[0005]The art of what changed the edge enhancement gain set value being 
conventionally proposed according to the set-up photographing scene, and 
changing the amount of edge enhancement by the normal mode and 
photographing mode in a digital copier is known. 

[0006]By the way, in a digital camera, since a gain will be applied also to a noise 
component when an edge enhancement process is performed to a picture signal, 
degradation of a picture will be caused as it is. For this reason, before applying 
the gain for edge enhancement, usually coring processing which removes a 
noise component is performed. 
[0007] 

[Problem(s) to be Solved by the InventionJHowever, since it is high-resolution 
compared with the picture from which a hyperresolution picture which was 
mentioned above was acquired by normal photographing mode, in said edge 



enhancement process, excessive edge enhancement will be performed as it is 
the same edge enhancement gain set value as the time of normal photographing 
mode, and an unnatural picture will be generated. 

[0008]Noises and a small picture signal is also deleted as it is the same coring 
preset value as the time of normal photographing mode, and in coring 
processing, the delicate textures of a photographic subject become difficult to 
appear in a picture. 

[0009]This invention is made in view of the above-mentioned actual condition, it 
is obtained by super resolution photographing mode, and the generation of the 
unnatural processing picture by the excessive edge enhancement to high 
resolution images of it is lost, and it makes it a technical problem to provide the 
imaging device which can fully express the textures of a photographic subject 
moreover. 
[0010] 

[Means for Solving the Problem]ln a mode selection means to which the 
aforementioned problem can set an imaging means and super resolution 
photographing mode other than normal photographing mode, and super 
resolution photographing mode, A high-resolution-images creating means which 
generates high resolution images of one sheet from a picture of two or more 
sheets photoed by said imaging means. As opposed to a picture photoed by said 



imaging means in said normal mode, or said high resolution images in super 
resolution photographing mode, As opposed to a picture signal by which 
performed coring processing according to a coring preset value, and coring 
processing was carried out further, It is solved by an imaging device provided 
with coring and an edge enhancement process means to perform an edge 
enhancement process according to an edge enhancement gain set value, and a 
preset value change control means which makes said each preset value change 
according to said photographing mode. 

[0011] According to this imaging device, to high resolution images generated by 
high-resolution-images creating means in a picture or super resolution 
photographing mode photoed in the normal mode by coring and an edge 
enhancement process means. Since coring processing is performed according 
to a coring preset value and an edge enhancement process is performed 
according to an edge enhancement gain set value, edge in the state where a 
noise was reduced is emphasized. According to each mode of photography and 
super resolution photography, a coring preset value and an edge enhancement 
gain set value are usually then changed by a preset value change control means. 
Namely, if said coring preset value and a gain set value are made smaller than 
each preset value at the time of normal photographing mode in super resolution 
photographing mode, while natural high resolution images will be obtained 



« 



without emphasizing edge too much, A fine picture signal which is the 
information on details of a picture is also employed efficiently, and delicate 
textures of a photographic subject are expressed enough. 
[0012] 

[Embodiment of the InventionJHereafter, the embodiment of this invention is 
described based on a drawing. 

[0013] Drawing 1 is an appearance perspective view of the digital camera as an 
imaging device concerning one embodiment of this invention, and drawing 2 is a 
rear elevation of the digital camera. 

[0014]ln drawing 1 and 2, in the front face of the camera body 1A in the digital 
camera 1 . The taking lens 1 1 , the finder window 14, the ranging window 19, etc. 
are formed, and CCD12 as an example of the image sensor which receives and 
carries out photoelectric conversion of the optical image by the above-mentioned 
taking lens 1 1 to the inside of the camera body 1 A is allocated. And the imaging 
means is constituted including the taking lens 1 1 and the CCD12 grade. 
[0015]The release (shutter) button 13, the photographing condition set key 17, 
the liquid crystal panel 18, etc. are formed in the upper surface of the camera 
body 1 A. The loading slot 16 which can insert and detach the archive medium 15 
is established in the side of the camera body 1 A. 

[0016]Looking at the display information of the liquid crystal panel 18, the 



photographing condition set key 17 is used, when performing setting out of zoom, 
etc. further, setting out of exposing conditions, such as diaphragm priority and 
shutter speed priority, the change of macro photographing, and. 
[0017]As shown in drawing 2 , the liquid crystal display monitor 111, the image 
processing mode set key 110, etc. for a live view display are provided in the 
back of the camera body 1A. By this image processing mode set key 110, 
normal photographing mode and super resolution photographing mode can be 
chosen and set up. 

[0018]This digital camera 1 can record the taken image by CCD12 on the 
archive medium 15 like the usual thing. 

[0019]By the way, although the resolution exceeding the resolution which a 
source image has is not obtained in the usual picture element density conversion, 
the high resolution images exceeding the resolution which a source image has 
are obtained in super resolution photographing mode, as the concrete method of 
this high-resolution-images generation processing, it is indicated by 
JP,6-225317.A and the JP,7-120665,A gazette, for example - it carries out 
[ ****** 1 and law or GP repeating method is mentioned. 

[0020] Drawing 3 is a block diagram showing the electric constitution of said 
digital camera 1, the Hosoya seal shows the flow of control data and a bold 
arrow shows the flow of image data. 



[0021 ]ln drawing 3 , CCD12 is set to enabled minute displacement in the optical 
axis direction, and drive displacement is carried out by the CCD position control 
part 54 at the time of the photography after the 2nd it in super resolution 
photographing mode. The CCD position control part 54 comprises a 
piezoelectric element, for example. 

[0022] A/D converter 51 changes the analog picture signal from CCD 12 into a 
digital image signal, and RAM52 once memorizes image data. 
[0023]ln normal photographing mode, while processing OFF is used, the 
high-resolution-images generation part 53 is super resolution photographing 
mode, it is made the processing ON, processes two or more image data 
produced by making carry out minute displacement of the position of CCD 12 for 
every photography, and generates the picture of high resolution. 
[0024]Coring and the edge enhancement process part 57 perform coring 
processing to a picture signal according to a coring preset value, and perform an 
edge enhancement process further to the picture signal by which coring 
processing was carried out according to an edge enhancement gain set value. 
[0025]Coring and the edge enhancement preset value switch part 58 change a 
coring preset value and an edge enhancement gain set value with directions of 
CPU50 according to said mode in which it was usually chosen of photography 
and the super resolution photographing modes. At this embodiment, by super 



resolution photographing mode, as shown in Table 2 of drawing 8 . a coring 
preset value and an edge enhancement gain set value are changed, for example 
so that it may become smaller than each preset value in normal photographing 
mode. 

[0026]The archive medium 15 memorizes the image data read from RAM52, and 
memorizes the image data generated by said high-resolution-images generation 
part 53 by super resolution photographing mode at normal photographing mode. 
[0027]CPU50 controls the whole digital camera 1 in generalization. For example, 
the photographing condition at the time of the release button 13 being pushed, 
the established state of the image processing mode set key 110, etc. are 
memorized, and also the taking-lens actuator 36 is controlled based on the 
ranging result in the ranging window 19. 

[0028]Here, said coring processing and an edge enhancement process are 
explained with reference to drawing 4 - drawing 6 . 

[0029]An edge enhancement process is processing performed in order to 
improve a lack in the feeling of edge by resolution being low. After specifically 
dividing into a low-frequency component and a high frequency component the 
picture signal acquired by the image pick-up, taking out only a high frequency 
component and applying a gain to this, they are a low-frequency component and 
the processing to compound. 



[0030]However, in this edge enhancement process, a gain will be applied also to 
a noise component and degradation of a picture will be caused. Then, it 
preceded applying the above-mentioned gain and coring processing has been 
performed to the picture signal. 

ft 

[0031 ]The following [ the value X in which this coring processing has an absolute 
value of a high frequency component ] consider that it is a noise component, 
make that signal zero, about the thing exceeding the value X with the absolute 
value of a signal, consider that the noise component of X appears and deduct 
only X from that signal. By carrying out like this, even if a noise component can 
be reduced and it applies the gain for edge enhancement after that, degradation 
of the picture by a noise can be controlled. 

[00321Said coring processing and an edge enhancement process are explained 
with reference to drawing 4 . As shown in drawing 4 , a low-frequency component 
is taken out in coring and the edge enhancement process part 57 by the low 
pass filter (3x3) 71 whose picture signal by image pick-up is a two-dimensional 
filter for edge enhancement. And as for the original picture signal, a 
low-frequency component is deducted by the adding machine 72, and only a 
high frequency component is sent out to the coring treating part 73. 
[0033]ln the coring treating part 73, processing which is regarded as the output 
of preset value-x-x being a noise component, and is set to "0" is performed in a 



high frequency component. Less than preset value-x corrects to the output to 
preset-value x Exceed, therefore the value which considered that the noise 
component appeared and deducted x. As for the preset value x, it is desirable 
that it is abbreviated-in agreement with a noise level, and, thereby, it can reduce 
a noise component. 

[0034]The high frequency component from which the noise component was 
reduced by the coring treating part 73 can apply a fixed gain according to the 
preset value shown in Table 1 of drawing 5 , for example for edge enhancement 
with the multiplier 74, and emphasis processing of a high frequency component 
is performed. The emphasized high frequency component is added to a 
low-frequency component with the adding machine 75, and is generated as an 
edge enhancement process picture signal with which noise component 
emphasis was controlled. The function coring [ at this time ] and processing 
before of edge enhancement and after processing is shown in drawing 6 by 
reference. 

[0035] Drawing 7 is a lineblock diagram showing coring and the edge 
enhancement process part 57 which were applied in this embodiment. 
[0036]An emphasis means 70A of a medium frequency ingredient by which 
coring and the edge enhancement process part 57 consist of the low pass filter 
(5x5) 71A, the adding machine 72A, the coring treating part 73A, the multiplier 



74A, and the adding machine 75A, The series connection of the ennphasis 
means 70 of the high frequency component which consists of the same low pass 
filter (3x3) 71 as drawing 4 , the adding machine 72, the coring treating part 73, 
the multiplier 74, and the adding machine 76 is carried out, and it is constituted. 
[0037]As an example of the coring value in the above-mentioned coring and the 
edge enhancement process part 57, and a gain set value, the contents shown in 
Table 2 of drawing 8 are adopted. The preset value of the parameter pattern 1 is 
specified in normal photographing mode, and the preset value of the parameter 
pattern 2 is specified in super-picture photographing mode. As shown in Table 2, 
in super resolution photographing mode, the coring preset value and the edge 
enhancement gain set value are set up smaller than each preset value in normal 
photographing mode. 

[0038]Subsequently, the photographing sequence by the digital camera 1 of the 
above-mentioned composition is explained with reference to the flow chart 
shown in drawing 9 and drawing 10 . A step is written as "S." 
[0039]Before photography, a user is with the photographing mode set key 17 
and the liquid crystal panel 18, and sets up setting out of exposing conditions, 
such as diaphragm priority and shutter speed priority, the change in white 
balance mode, etc. Looking at the liquid crystal display monitor 111, a user 
operates the image processing mode set key 110, and chooses normal 



photographing mode or super resolution photographing mode. 
[0040]ln drawing 9 , by S101, if the release button 13 is pushed, it judges 
whether it is **** and the release button 13 is pushed (the judgment of SI 01 is 
YES), it will be SI 02 and, as for CPU50, CPU50 will read the photographing 
condition at that time, and setting out of image processing mode, the time of the 
release button 13 not being pushed - the judgment of (SI 01 - NO) - it waits 
until it is pushed. Then, ranging is performed by SI 03. 

[0041] When [ when it judges whether CPU50 is super resolution photographing 
mode OFF and super resolution photographing mode OFF is set up in SI 04 
therefore ] normal photographing mode is set up, the judgments of (SI 04 are 
YES) and SI 05, It points, as the preset value of the parameter pattern 1 of the 
drawing 8 table 2 which Is usually an object for photography adopted in CRU50 
to said coring and the edge enhancement preset value switch part 58, and the 
usual photography is performed. 

[0042]That is, after CPU50 drives the taking lens 1 1 via the taking-lens actuator 
56 by S106 so that it may focus for a photographic subject, it is S107, and the 
reset time which CPU50 computed is integrated with CCD12 (exposure), and a 
picture signal is read as data in S108. 

[0043]The picture signal read by S109 is changed into digital image data by A/D 
converter 51, and digital image data is stored temporarily in S110 RAM52. And 



in S111, CPU50 sets the high-resolution-images generation part 53 as OFF 
(with no processing), and it in S112. The image data from RAM52 is read, and 
by said coring and the edge enhancement process part 57, after performing 
image processing to image data according to the coring preset value and gain 
set value of said parameter 1, it records on the media 15 by S1 13. 
[0044]On the other hand, in SI 04, when super resolution photographing mode 
ON is set up (the judgment of SI 04 is NO), it becomes super resolution 
photography arid progresses to S201 of drawing 10 . 

[0045]ln drawing 10 , by S201, it points, as the preset value of the parameter 
pattern 2 of the drawing 8 table 2 which is an object for super resolution 
photography adopted in CPU50 to said coring and the edge enhancement 
preset value switch part 58, and super resolution photography is performed. 
[0046]That is, after CPU50 drives the taking lens 1 1 via the taking-lens actuator 
56 by S202 so that it may focus for a photographic subject, it is S203, and the 
reset time which CPU50 computed is integrated with CCD 12, and a picture 
signal is read as 1st image data by S204. 

[0047]By S205, the read image data is changed into digital image data by A/D 
converter 51, it is S206 and digital image data is stored temporarily RAM52. 
[0048]Subsequently, in S207, if the position of CCD12 judges whether only the 
specified quantity was displaced and only the specified quantity is being 



displaced while CPU50 carries out specified quantity displacement of the 
position of CCD 12 via the CCD position control part 54 (the judgment of S207 is 
YES), it will progress to S208. the time of not having carried out specified 
quantity displacement the judgment of (S207 - NO) - it waits until it is 
displaced. 

[0049]ln S208, CPU50 judges whether two or more sheets were photoed. While 
not photoing two or more sheets, the judgment of (S208 returns to NO) and 
S202. and performs 2nd photography like the above. If two or more sheet (two 
sheets) photography is carried out (the judgment of S208 is YES), by S209, the 
image data of these two sheets is read from RAM52, the high-resolution-images 
generation part 53 will be turned ON, and the super resolution image of one 
sheet will be generated from the picture of two sheets S210. 
[0050]Subsequently, in S211, by said coring and the edge enhancement 
process part 57, after performing image processing to super resolution image 
data according to the coring preset value and gain set value of said parameter 2, 
it records on the media 15. 

[0051]Thus, in super resolution photographing mode, the unnatural image 
generation by excessive edge enhancement Is avoidable from having made the 
coring preset value and the edge enhancement gain set value smaller than each 
preset value in normal photographing mode, furthermore ~ since the minute 



information on a picture is efficiently employed also after coring processing -- the 
spot of the hide of a mandarin orange — the textures of photographic subjects, 
such as admiration and a feeling of fuzz of the hide of a kiwi, are expressed 
enough. 

[0052]As coring and the edge enhancement process part 57, as shown not only 
in the thing of drawing 7 but in drawing 11 , An emphasis means 70A of a 
medium frequency ingredient to have the low pass filter (5x5) 71 A, Via the 
selectors 61 and 62, carry out multiple connection of an emphasis means 70 of a 
high frequency component to have the low pass filter (3x3) 71, and in normal 
photographing mode. As it processes by an emphasis means 70 of a high 
frequency component to have the low pass filter (3x3) 71 and being processed in 
super resolution photographing mode by an emphasis means 70A of a medium 
frequency ingredient to have the low pass filter (5x5) 71 A, it may be the 
composition which controls said selectors 61 and 62. 

[0053]That is, generally, since it becomes a key objective that image processing 
in normal photographing mode raises resolution, it is good to emphasize a high 
frequency component, and an emphasis means 70 of a high frequency 
component to have said low pass filter (3x3) 71 is used. On the other hand, in 
image processing in super resolution photographing mode. Since sufficient 
resolution is obtained, it is more effective to aim at an improvement of the 



contrast by emphasis of a medium frequency ingredient, and an emphasis 
means 70A of a medium frequency ingredient to have the low pass filter (5x5) 
71 A for it is used rather than aiming at emphasis of a high frequency component. 
[0054]The example of the coring preset value in coring and the edge 
enhancement process part 57 which are shown in drawing 11 , and an edge 
enhancement gain set value is shown in Table 3 of drawing 12 . The preset value 
of the parameter pattern 3 is specified in normal photographing mode, and the 
preset value of the parameter pattern 4 is specified in super-picture 
photographing mode. 

[0055]As the coring preset value in coring and the edge enhancement process 
part 57 which are shown in drawing 7 , and an edge enhancement gain set value, 
even if it adopts the parameter patterns 3 and 4 of drawing 12 , the same effect 
as the above is demonstrated. 

[0056]They may be other methods, although it shifted and the technique was 
adopted and explained as the method of super-picture photography by the 
above-mentioned embodiment. 
[0057] 

[Effect of the Invention] As mentioned above, since this invention enabled 
change of a coring preset value and an edge enhancement gain set value 
according to the mode in which photography and super resolution photographing 



mode were usually chosen, If the coring preset value and gain set value in super 
resolution photographing mode are made smaller than each preset value at the 
time of normal photographing mode, while it is lost that edge is emphasized too 
much and being able to generate a natural picture, a fine picture signal is also 
employed efficiently and the delicate textures of a photographic subject can be 
expressed good. 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1] lt is an appearance perspective view showing the digital camera 

concerning the embodiment of this invention. 

[Drawing 21 lt is a rear elevation showing a digital camera similarly. 

[Drawing 3] lt is a block diagram showing the electric constitution of a digital 

camera similarly. 

[Drawing 4] lt is a fundamental lineblock diagram of coring and an edge 
enhancement process means. 

[Drawing 5] It is a table showing an example of the coring preset value applied to 
composition, and an edge enhancement gain set value in drawing 4 . 



' [Drawing 6] It is an explanatory view of the function processing before of coring 
and edge enhancement, and after processing. 

[Drawing 7] lt Is the lineblock diagram of coring and an edge enhancement 
process means applied to this embodiment. 

[Drawing 8] lt is a table showing an example of the coring preset value applied to 
the composition of drawing 7 , and an edge enhancement gain set value. 
[Drawing 9] lt is a flow chart which similarly shows the photographing sequence 
of a digital camera. 

[Drawing 10] It is a flow chart which shows the processing at the time of 
super-picture photographing mode. 

[Drawing 11] lt is a lineblock diagram showing other examples of coring and an 
edge enhancement process means. 

[Drawing 12] [t is a table showing an example of the coring preset value applied 
to the composition of drawing 11 , and an edge enhancement gain set value. 
[Description of Notations] 

I .... Digital camera (imaging device) 

II ... Taking lens 
12 ... Image sensor 

58 ... Coring and edge enhancement preset value switch part (preset value 
alteration means) 



57 ... Coring and edge enhancement process part 
70 ... Emphasis means of a high frequency component 
70A .. Emphasis means of a medium frequency ingredient 
110.. Image processing mode set key (mode selection means) 
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